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Statistics of Repetitions 

In ord r to be able to obtain reliable estimates of the value 
of given repeats we need to have information about repetition 
in plain language. Suppose for example that we haveplaced two 
messages together and that v/e find repetitions consist! ig 
of jcwo a tetr8gr-nrie , two bigrammes and fifteen singel letteras, 
and that the total ’overlep* was 105, i.e. that the maximum 
possible number d»f repetitions whiorh could be obtained by 
altering letters of th e mes~ages is 105; sj u^ose also that 
the lengths of the mes sages are 200a nd 250: in suoh a c p se v/hat 
is the probability of the fit being right, no oth er information 
about the days trsffios being taken into cons i der- 1 ion, but 
information about th e ch er n cter of the unenciohered text 
being available id considerable quantity? 

In theory this can be solved as follows, e take e vast number 
typical decodes 

of mssxxxKS, say 10 , and from these we select a 131 of length 

200 and all of length 250. We encipher all of these message® at 

all possible o sitions on the machine (neglecting for simplicity 

the complication dueto different drily keys). We then compare 

each message 200 long with each 250 long in such *» way as to get 

an overlap of 105 as with the fit under consideration. From the 

resulting comparisons v/e pick out .iust those cases ’"here the 

in 

repetitions have precisely the same fcrm es^the case in question. 
This set of comparisons will be called the ’relevant' comparisons. 
Amomg th e relevant comparisons there will be some which are 
’right' comparisons, i.e. where corresponding letters of the 
two messages were enciphered with the same position of tie machine c 
The probability that our original fit was right can now be express- 
ed in the form 




Number of right relevant comparisons 
T'ot'al niimber of relevant comparisons 




t - 




The work involved in this theoretical method can he V' stly 
reduced if we make e few harmless as umptions. In the first 
place if we assume that the encipherment keys at the various 
positions of the machine are* hatted* we can calculate the number 
of relevant wron g comparisons. Sup">oae t’ne total number of 
repeated letters in th e sse in question is R, then 

Number of relevant wrong comparisons » ( 1 ) R / %£ \ 

Total number of wrong comparisons ( 26 ) V ^6 



For thr calculation of the number of relevant right comparisons 
we have to make other assumptions. The sort of assumption that 
we heed is that a repetition in one 41a ce is not made any the 
more or less likely by a repetition elsewhere. Actually this 
assumption would not be quite true, as it clearly does not 
hold in the case of adjacent letters. For most practical purposes 
I think the following as umption is sufficiently near to the truths- 
If we know thst at a certain point P there is not a repetition . 
th en knowledge that there is or is not a repet i tion at a 
point A before P does not make a repetition at a point B after P 
either m o re likely or les q like ly. TtlXhxXhixv si sxjmntlimxxKX 



x®HH 3 pcklis: The prob abili ty of a repetit i on p t p ny point is ° Iso 

independent of its distance fro m the ends of either message . 

With these assumptions we could get the right distribution of 

numbers of comparisons between thex various repetition figures if 

we assume the repetition figures for the comparisons constructed 

large 

in this way. We are given an urn containing a number of xTlxx 
Hixxsxorx oards, some bearing the words ’no repeat’, some 

’simple repeat’, some ’bigramme’, some’ trigrarame’ , and so on. 

To construct a random s°mple If repetition figures for 

comparisons of given length we maka a series of draws from the 


u r ^ 




The first fe- d rev/s determine the repetition figure for the 
comparison 

first , th next few for the next axxx xxs comparison, end 

so on. When we draw »no repeat* we have to add a ’o' to the 
repetition figure, when we draw 'simple repeat* we add *io* , 
for ’bigramme’ we edd ’xxo’ and so on. When we have got to the 
right length 0f overlap required the comparison is completed 
and our next dr- ws refer to the next comparison, xlnra If it 
happens that the right length is never reached because we * Jump 
past it* then we scrap that comparison, a n d go on to the next. 

As an ex°mple suppose that we are making comparisons W ith a n 
overlap of 12, a n d th°t our first draws a re ’ tetragramme’ , 'no reo' 
(no rep*, T no rep', *bigremme*, ’no rep*, ’tri&ram e* 13- gramme, 
then ’no rep’ 13 times, our first two comparisons will have 
the repetition figures 

xxxxooooxxoo 

oooooooooooo 

the one starting xxxo being rejected because we never reach the 
right lenght of overlap, (This arrangement requires th°t every 
repetition figure should end with o, and therefore xrssranmhlyxHna 
the genuine repetition figure should be obtained by crossing this 
of f * but I shall not be too meticulous about details arising 
ffom the ends of the comparisons). The number of draws renuire^ 
to produce a given figure is thKrsfsirar the number of non repeating 
letters, i.e. the overlap les^ the number of repeating letters. 

-ith our convention about crossing off the last letter we h-ve to 
add 1. 

Two problems arise from this picture 

1) How do we calculate the correct proportions of cards in the 

urn? 

2) Given the proportions of the card^ in the urn, how do we 
calculate the number of ^ight relevant comparisons, and henoe 
the probability of a given fit? 



The correct ^ropgrtion of th e crrds in the urn can be 
calculated from the actual distribution of repetitions in the 
case of messages correctly set, or, what comes to the same 
thing, in messages unenci'hered «nd arbitrarily set. Let us 
suppose that we have p large number of such comparisons of 
u enciphered messages, and that the mes-ages »>r sufficiently 
long that complications arising from the ends of the mes ages 
can be neglected. The proportion of c*rds bepring the words 
’simple repeat’ , 'Bigremw e’ , ’trigremme’ etc must obviously be 
in the same ratio as the number of corresponding repeats in 
our comparisons. The number of ’no repeat 1 cards will be 
calculated slightly differently as we have to subtract one 
case of ’no repeat’ for eech sequence of repeating letters. 

To get the best value from giben material we naturally 
make every possible comparison. If we do this the right number 
of tepetitions can b e calculated quite easily without 
actual y making the comparisons. Th eoretical]y we can imagine 
the complete set of comparisons made in this way. Fir^t of all 
we write out all th e decodes (say 50 of them) one after another 
round a circle: suppose that the number of letters on this 
circle is N. 'The whole isthen repeated on a concentric circle. 

All pos ible comparisons cen be made by rotating the one 
circle with respect to the other. From ±h bxk th ese we have 
to remove the comparison in which the circles are not rotated 
at all, for obvious reasons. Also when the rotation is more tha 
180 we get essentially the same comparison as one with less than 
180°. The net effect of this, taking into account also th e sp wt 
special case of exact 180° rotation, is th at the totpl overlap 
of all the comparisons 'sd . No- let us consider for 
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example the total number of tetragranr’e repeats in all these 
comparisons. These can be divided into the reneats arising 
from AAAA those from AAAB . ... those from ZZZZ, the largest 
cpntribution arising presumably from such tetra grammes ss EINS. 
The number of tetragrammes arising from EINS consists of the 
n umber of nairs of hexegrammes such as QEINSR, VEINSW in ■vr hich 


th e first letters of each are different, the l$st different, 

and the remainder spell EINS. This number of nairs we will call 

the ♦ actual number of tetragram e repea tsirising from EINS8. 

The'adtual number of tetragramme reneats' is obtained by 

summing over AAAA, AAAB, ... ,EINS, .. .ZZZZ. This 'actual' number is 

not easily calculated directly, but we can more easily obtain 
£ 

the 'apparent number of tetragramme repeats', and this leads 

t, 

to the actual number. T^e ' apparent number of tetragramme repeats 

arising from EINS’ is definad to be the number of pairs of occur" 

£ 

ences of EINS in the material, and Tthe apnarpnt number of 

\s> % 

tetragramme repeats ' defined by summation. We can also define 

the apnarfnt number of te/tragramme repeats in a comnarison 8s 

the numbers of different series xxxx in the comnarison. ‘^hus 

£ 


a heptagramne repeat gives four annarant tetragramme reneats. 

The actual numbe • of reneats cen be calculated from th° an-iar^ht 

e. 

ib this way. Let M r be the apnar^nt number of r-grammes, and 
h N r th e actual number. Then 








M. - n 


N. 
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and to carry these two stages further the±n we went to go with the 

actual numbers. In practice octagramme repeats are so certain to 

be right that it will be sufficient tohave statistics only as 

far as heptagremres . W e therefore need statistics of xk±ek 

apparent numbers of repeats as far a S (J-grammes. To get these 

numbers of apparent repeats it is sufficient to take all the 

9 -grammes in the material (i.e. oh the circle) a n a to put th em 

into alphabetical order, -^his can be done v r ry conveniently by 

say 

Hollerith. The nuiiber of trigramme repeats can then be found 
very simply (although with a good de* 1 of labour) by fcefe 
considering only the first three letters of each 9-gramme. 

Supnose we renote fcgcxi by t a typical trigram e^and by the 
n umber of its occurrences, then the apparent number of trigramme 




When calculating the pronortions of cards in th e urn we 

N (N-i:> 

must remember that the total number of cards is not 2 
but is less than this by 2. ^ /V/ . 

In our later calculations it is convenient to regard the 
comparisons in wrdng places as also constructed by drawing from 
an urn. In this case we easily th" t the apparent number of 
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repeat cards is 
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We now turn to the proble- of c lulating th e probability 

of b given fit when we kno/’ the proportion^ of r^gramme cards in 

the urn for each r. The calculation is going to he slightly 

complicated by the convention which we introduced, that not all 

drawings can lead to e comparison. We have therefore to 

do 

c lculete the pronortion of draws which lead to a comparison, 
i.e. in which the length does not overshoot the mark, Th e 
andwHr is that as he length of ovarian tends to infinity th e 


proportion t nds to 

2 A" 

this is — , 

2- b 




i in the case of hatted material 


Now put Aw i- Td t 


Cons ider 


there are A 
The number of 


r-grammes. ifcrcirx? 


re net it ion figure in which 

let the overlap b« L, 

n 'w‘ nn rr.nru t -lr- (_+ I “ * 1^) k ^ 


The proportion of right draws which are Relevant is 

90 

rt, 

and the proportion of th e right comparisons which are relevant 

is (assuming L reasonably 1 rge) 


0 + & R 


*o 


L+! - T(tb, T- ku. 
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Similarly xitkxttocKxmra calculating with the urn ’"hose 

proportions were made up from hatted material we find for the 

comparisons 

proportion of T ”rong irarucx which are relevant 

2 L %+*l)**- yL /l 


Hence the odds* on our fit are 


W4&i 


f 2. L r *l)k r -T* f it <T 

V’ A — — ( £T- ) II ^ J 

wh. ere A is the a priori odds. This is most conveniently 
written as 

wh ere ^ , 2>LA p nd %1 , a i" ^ 

1 TTo ^ “ /*■! 
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*The odds on an event are defined to be the pro atiili y of 
the event divided by the probability of its negation 





